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Abstract. A matrix (and any associated linear system) will be referred to as struc- 
tured if it has a small displacement rank. It is known that the inverse of a structured 
matrix is structured, which allows fast inversion (or solution), and reduced storage re- 
quirements. According to two definitions of displacement structure of practical interest, 
it is shown here that several types of inverses are also structured, including the Moore- 
Penrose inverse of rank-deficient matrices. 
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1. Introduction. Close to Toplitz or close to Hankel matrices ap- 
pear in various areas including signal processing and automatic control 
(e.g. prediction of second-order nearly stationary time series). In radar or 
sonar (or more generally antenna processing) , Toplitz matrices are encoun- 
tered when far-field sources impinge an array of regularly spaced sensors 
after propagating through an homogeneous medium. If 2-dimensional reg- 
ular arrays are utilized, then block-Toplitz matrices can be found. Other 
applications include optics, image processing (when the spreading function 
is shift invariant), differential or integral equations under certain boundary 
conditions and for certain discretizations (e.g. oil prospecting), seismics, 
geophysics, transmission lines, and communications. . . In general, these ap- 
plications correspond to the solution of some inverse problems. When shift 
invariance properties are satisfied, the linear operator to invert is Toplitz, 
or block-Toplitz, and it is dealt with a deconvolution problem. 

However, Toplitz matrices in the strict sense are rarely encountered in 
the real word, because the abovementioned invariance properties are not 
satisfied. For instance, second-order stationarity of long time series, or 
homogeneity of propagation media, are idealized assumptions. In antenna 
array processing, the decalibration of the array is the main cause of many 
problems, among which the deviation from Toplitz is one of the mildest 
ones. For instance in sonar, decalibration occurs because of the effects of 
pressure, temperature, and usage, among others. Another major cause of 
problems is the distorsion of wave fronts impinging the array due to inho- 
mogeneity of the medium or to local turbulences (note that improvements 
can be obtained by assuming that the celerity is random with a small vari- 
ance, but this is out of the scope of the present discussion) . Lastly, a simple 



* This work has been carried out while the author was visiting the Institute for 
Mathematics and its Applications, University of Minnesota, Minneapolis, in April 1992. 

' Thomson-Sintra, Sophia Antipolis BP138, 06561 Valbonne Cedex France. The 
author can be reached at na.comon@na-net.ornl.edu. 

1 



2 



P. COMON 



deviation from Toplitz that has been already studied is the effect of limited 
length of the data. The proximity to Toplitz then depends on the way the 
matrix is calculated: its displacement rank ranges from 2 to 4 under ideal 
assumptions. 

Since the set of Toplitz (or Hankel) matrices is a linear space, it is 
easy to compute the closest Toplitz approximate of any matrix by a simple 
projection. However, this operation should be avoided in general, since it 
would destroy other important structures (e.g. just the rank). On the other 
hand, finding the best approximate of a matrix by another of given rank 
and given displacement rank is still an open problem. It is true that some 
simple iterative algorithms have already been proposed in the literature 
for the Toplitz case, but the convergence issue has not been completely 
covered. 

Since the early works by Schur (1917), Levinson (1947), Durbin (1960), 
Trench (1964), and Bareiss (1969), a lot of work has been done. In par- 
ticular, Kailath and others introduced in the seventies the concept of dis- 
placement rank, which allows in some way to measure a distance to Toplitz 
[16]. By the way, the concept of displacement rank may be seen to have 
some connections with integral and differential equations [18]. An excellent 
survey of related works can be found in [17]. Other recent investigations 
are also reported in [6] . 

It is known that a linear system Tx — b can be solved with 0(n 2 ) 
flops if T is a n x n Toplitz matrix. If T is just only close to Toplitz, it is 
useful to define a displacement rank, 5, measuring a distance to the Toplitz 
structure [11]. Then it has been shown that the solution requires only 
0(5n 2 ) flops, to be compared to the 0(n 3 ) complexity necessary to solve 
a dense linear system of general form. More recently, superfast algorithms 
have been proposed to solve Toplitz systems, and their complexity ranges 
from 0{nlog 2 n) to O(anlogn), a < n, [1] [2] [3]. 

The displacement rank of a linear system is clearly related to the com- 
plexity of its solution. It has been shown in [4] [5] that this complexity 
reduction also holds for the calculation of various factorizations, provided 
the Schur algorithm is run on the appropriate block-matrix. In this paper, 
the displacement rank will be defined in a slightly more general framework, 
such that the structure of a wider class of matrices can be taken into ac- 
count. In this framework, the first step in the quest of fast algorithms is 
to check whether the system considered has a displacement structure, and 
under what displacement operator its displacement rank is the smallest. 
Building explicitly fast algorithms taking advantage of this structure is the 
next question. However, our investigations are limited in this paper to the 
study of the displacement rank itself, and it will not be discussed how to 
build the corresponding fast algorithm. 

The paper is organized as follows. Definitions and basic properties are 
given in section 2. In section 3, the structure of inverses and products 
of full-rank structured matrices is analyzed. Section 5 is devoted to the 
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study of structured rank-deficient matrices, and utilizes preliminary results 
derived in section 4. 

2. Definitions and first properties. The structure that will be 
considered in this paper is exclusively the displacement structure [16] [11]. 
Roughly speaking, a structured matrix is the sum of displaced versions of 
a unique generating matrix of small rank. For instance, sparse matrices 
may not have any interesting displacement structure. Displacement op- 
erators can be defined in different ways, and two definitions will be used 
subsequently. 

Definition 2.1. For any fixed pair of matrices (Z,N) of appropriate 
dimension, the displacement of a matrix A with respect to displacement 
operator V ' z,N is defined as 

(1) V z ,nA = A- ZAN. 



Definition 2.2. For any fixed pair of matrices (Z,N) of appropriate 
dimension, the displacement of a matrix A with respect to displacement 
operator Az,n is defined as 

(2) Az,nA = ZA- AN. 



In the remaining, matrices Z and N will be referred to as displacement 
matrices, and the pair {,Z,N} to as the displacement pattern. . Once 
the above definitions are assumed in the primal space, then it is conve- 
nient to use the definitions below in the dual space, denoting by (*) the 
transposition: 

Vn,z(A*) =A*-NA*Z, 
(3) Ajv, z (A*) = NA* - A*Z. 



Definition 2.3. Matrices for which any of the four displaced matrices 
(1), (2), (3) or (3) has a rank bounded by a value that does not depend on 
the size of A will be referred to as structured. This rank will be called the 
displacement rank of A with respect to the displacement operator considered, 
and will be denoted as 5^ N {A}, 5jj Z {A*}, 6z N {A}, or S^ Z {A*}. 

This definition is consistent with [6]. Displacement matrices Z and N 
are usually very simple (typically formed only of ones and zeros). Addition- 
ally, it can be seen that the displacement operator (1) is easily invertible 
as soon as either Z or N is nilpotent. To see this, assume that Z k+1 = 
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and explicit the displacement V ' z,n in the sum 

k 

Y,^zm{Z 1 AN 1 }. 

i=0 

Then this expression can be seen to be nothing else than A itself. For 
additional details, see [17] and references therein. Note that the results 
shown in this paper will not require a particular form for matrices Z and 
N (nilpotent for instance), unless otherwise specified. Other considerations 
on invertibility of displacement operators are also tackled in [4]. In [20], 
displacement operators are defined (in a manner very similar to [4]), but 
displacement ranks of products or pseudo-inverses are unfortunately not 
obtained cxplicitely. Lastly, other displacement structures, including (2), 
are being investigated by G.Heinig. 

Example 2.4. Denote S the so-called lower shift matrix: 

/° \ 

(4) S= 1 

V '• I" o/ 

For Hankel matrices, it is easy to check out that we have 

(5) Sl N {H}<2, for (Z,N) = (5,5), 

(6) 8z,n{H}<2, for (Z, N) = (5, 5*), 

whereas for Toplitz matrices, we have 

(7) 8^ N {T}<2, for (Z,N) = (S,S*), 

(8) 5* N {T}<2, for (Z, N) = (S, S). 

In these particular cases, the non-zero entries of displaced matrices are 
indeed contained only in one row and one column. These four statements 
hold also true if matrices Z and N are permuted. In other words, 

6£,^ S {H}<2, and Sj^ s {T}<2. 



It turns out that the definitions 2.1 and 2.2 yield displacement ranks 
that are not independent to each other. We have indeed the following 

Theorem 2.5. For any given matrices Z,N,A, the two inequalities 
below hold 

(9) Sl N {A}<5^ >N {A} + Sl z .{I}, 

(10) 5^ N {A}<5^. tN {A} + 6l z .{I}, 
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where I denotes the identity matrix having same dimensions as A. 

Proof. V z ,nA = Z(Z*A-AN) + (I-ZZ*)A shows the hrst inequality, 
and A Z , N A = Z(A - Z* AN) - (I - ZZ*)AN shows the second one. □ 

Example 2.6. If A is a circulant Toplitz matrix, e.g., 

bed 




then it admits a displacement rank 3% N {A} — 1 provided the following 
displacement pattern is assumed: Z = S3 as given by (4), and 



N 






V 1 



\ 

1 
1 
/ 



In this example, we also have S^, N {A} = 1, which is conform to theorem 
2.5. 

Example 2.7. Let A be a m x n Toplitz matrix. Define N — S n , and 



( 


1 





°\ 













1 








1 


V 











Then it can be seen that (5f, N {A} = 2, and <5j N {A} = 3. This example 
shows that equality can occur in theorem 2.5. 

Example 2.8. If T is Toplitz to x n and H is Hankel to x p, then the 
block matrix (T H) has a displacement rank equal to 3 with respect to the 
displacement pattern {Z, N} = {S m , S* © S p }. 

The notation A(BB will be subsequently used when A and B are square 
to denote the block-diagonal matrix having A and B as diagonal blocks. 



3. Displacement of various inverses and products. There is a 
number of situations where the displacement rank of a matrix can be quite 
easily shown to be small. Since our main concern is inverses, let us start 
with the simplest case. 

Theorem 3.1. Let A be an invertible square matrix. Then 

(11) (i) 5% N {A] = S^ziA- 1 }, and (ii) Sj iN {A} - ^{r 1 }. 

In other words, A and A^ 1 have the same displacement rank with respect 
to dual displacement patterns. 
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To prove the theorem, it it useful to recall the following lemma. 

Lemma 3.2. Let f and g be two linear operators, and denote E^ 
the eigenspace of operator h associated with the eigenvalue A. If A is an 
eigenvalue of fog, then it is also an eigenvalue of gof . In addition, the 
eigenspaces have the same dimension as soon as A is non-zero: 



Proof. Assume A is an eigenvalue of fog. Then for some non-zero 
vector x, fog(x) — Ax. Composing both sides by operator g immediately 
shows that 



Next there are two cases: (i) if g{x) ^ 0, then g{x) is an eigenvector of gof 
associated with the same eigenvalue A; (ii) if g(x) = 0, then fog(x) = 
and necessarily A = 0. Now assume without restricting the generality of 
the proof that dim{El° 9 } > dim{E 9 > f^}. Then there exists a vector x 
in E f x ° 9 such that g(x) = (since otherwise relation (12) would imply 
that g(x) is also in E 9 ^ f ). Yet composing by / yields fog(x) — and 
consequently A = 0. As a conclusion, if A ^ 0, eigenspaces must have the 
same dimension. □ 

Proof, of theorem. We have by definition S% N {A} = rank{ZA — 
AN} = rank{Z - ANA' 1 }, and Sft^A- 1 } = rankiNA' 1 - A~ X Z} = 
rank{AN A^ 1 — Z}. But these two matrices are opposite, and therefore 
have the same rank. This proves (i). 

Similarly since the rank does not change by multiplication by a regular 
matrix, we have 5j N {A] = rank{A - ZAN} = rank{I - ZANA^ 1 }. On 
the other hand S^^A' 1 } = rank{A~ x —NA~ X Z} = rank{I-N A^ZA}. 
Now from lemma 3.2 we know that ker{I — fog} and ker{I — gof} have 
the same dimension. If / and g are endomorphisms in the same space, this 
implies in particular that rank{I — fog} = rank{I — gof}. Now applying 
this result to / = ZA, g = NA~ X eventually proves (ii). □ 

The proof that an invertible matrix and its inverse have the same dis- 
placement rank has been known for a long time, and proved for symmetric 
matrices [17]. However, the proof for general Toplitz matrices seems to 
have been given only recently in [6] for a displacement of type (1). Our 
theorem is slightly more general. 

Corollary 3.3. For any given square matrix A, let the regularized 
inverse be given by R = (A + rjI) -1 , for some number r] such that A + t]I is 
regular. Then the displacement ranks of A and R are linked by the inequality 
below 



dim{E{° 9 } = dim{E 9 ° f }. 



(12) 



gof{g{x)) = Xg(x). 



(13) 



Sn,z{ r }< S z,n{A} + S z , n {I} 
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this inequality holding for both displacements V and A. 

Proof. Just write Z {R} = 5^ N {R~ 1 } — 5 Z n{A + r/I}, and since 
the rank of a sum is smaller than the sum of the ranks, we eventually 
obtain the theorem. In order to prove the inequality for the displacement 
A, proceed exaclty the same way. □ 

When close to Toplitz or close to Hankel matrices are considered, the 
displacement matrices Z and N are essentially either the lower shift matrix 
S or its transposed. In such a case, it is useful to notice that 

(14) 8l s .{I} = 5j. tS {I} = l. 

On the other hand for any matrix Z (and S or S* in particular): 

(15) 5% Z {I] = 0. 

For a Toplitz matrix T, we have a stronger (and obvious) result, be- 
cause T and T + rjl are both Toplitz. 

8j;s{ R } = 5 ls-in 

Corollary 3.4. Let M be the 2 x 2 block matrix below 

»-{ A c I). 

where A and D are square of dimension n\ and n 2; respectively. Assume 
M and A are invertible. When the last ni x n-i block of the matrix M^ 1 is 
invertible, it can be written as A -1 , where A is the so-called Schur comple- 
ment of A in M: A = D — CA~ 1 B. If M has a displacement rank 8n,z{M} 
with respect to a displacement pattern {Z, N} — {Z\ Q)Z 2 ,Ni(B N 2 }, where 
Zi and Ni are x nj matrices, then the displacement rank of A satisfies 
the inequality below for both displacements V and A: 

(16) S Z2 ,nA A } < Sz,n{M}. 



Proof. Applying twice the theorem 3.1, and noting that the rank of M 
is always larger than the rank of any of its submatrices, yield Sz 2 .n 2 {A} = 
Sn^zAA- 1 } < 6 N}Z {M- 1 } = 5 Z , N {M}. □ 

This kind of property has been noticed for several years by Chun and 
Kailath. See for instance [4] [6] . This corollary restates it in the appropriate 
framework. 

Theorem 3.5. Let A\ and A 2 be two full-rank matrices of size n\ x n 2 
and n 2 x m, respectively, with n\ <n 2 . Then the displacement rank of the 
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matrix A 1 A 2 is related to the displacement ranks of Ax and A 2 for either 
displacement V or A by 

(17) &z u zA A iM} < S Zl ,N 1 {A 1 } + 5 NuN2 {I n2 } + S N2 .z 2 {A 2 }, 

Proof. To prove the theorem, form the square matrix M of size m +n 2 : 

hi n 

consider the displacement pattern {N 2 © Z\, N\ © Z 2 } and apply corollary 
3.4. Again, since the displacement pattern is block-diagonal, the displaced 
block matrix is formed of the displaced blocks. 

In the present case, the Schur complement is precisely the product 
—A\A 2 . This proof is identical to that already proposed in [6] for particular 
structured matrices. □ 

Note that if N x = N 2 , (15) implies S$ iN2 {I} = 0. On the other hand, 
if Ni = N 2 = S, then 6% at 2 {^} = 1 from (14). For particular displacement 
matrices Z and N, the general bounds given by theorem 3.5 may be too 
loose. In particular for Toplitz or Hankel matrices, the corollary below is 
more accurate. 

Corollary 3.6. Let S be the lower shift matrix defined in (4-), T\ 
and T 2 be Toplitz matrices, and Hi and H 2 be Hankel. Then under the 
conditions of theorem 3. 5: 

(18Xa) $ s {TiT 2 } < 4, (b) 6l s {HxH 2 } < 4, (c) ^.{TWa} < 4, 
(190^) SsMTiTi} < 4, (b) Sls.iHiH*} < 4, (c) S^T^} < 4. 

Proof. Equations (18) result from a combination of example 2.4 and 
theorem 3.5. In fact, take Z { = Ni = S for (a), Z x = Z 2 = N{ = 7V 2 * = S 
for (b), and Z 1 =N 1 =N 2 = Z* 2 = S for (c). 

On the other hand, if we try to apply theorem 3.5 to prove (19), we 
find a result weaker than desired, for we obtain 5 V < 5. A more careful 
analysis is therefore necessary. Restart the proof of theorem 3.5: if T\ and 
T 2 are full rank Toplitz, the displaced block matrix V ' s®s,S*®S*M has the 
following form: 

\ 



where crosses indicate the only locations where the matrix is allowed to 
have non-zero entries: only in two rows and two columns. Such a matrix 



V/ VT 2 
VTi 





X 
X 
X 


X 


XXX 
X | 
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is clearly of rank at most 4. Following the same lines as in theorem 3.5, it 
can be seen that the product 7iT 2 has a displacement rank bounded by 4. 

A similar proof could be derived in the case of two Hankel matrices, 
and will not be detailed here. In order to prove (19c), let us consider finally 
the block matrix 

Assuming the displacement pattern {S © S, S* (B S}, the displaced matrix 
VM is now of the form 

\ 



/ 

which is again obviously of rank at most 4. The last result follows. □ 

The theorem 3.5 was valid only for full-rank matrices of transposed 
sizes. For further purposes it is useful to extend it to products of rectan- 
gular matrices of general form. 

Theorem 3.7. Let A and B be m x n and n x p matrices. Then the 
product AB is also structured, and the inequality below holds: 

(20) S% AiN JAB}<5% AiNA {A} + 5% A , ZB {I n } + S^ NB {B}, 

where I n denotes the n x n identity matrix. 
Proof. Write first the displaced matrix as 

A Za , Nb AB = (Z A A - AN A )B + A(N A B - BN B ). 

Then splitting the second term into A(N A - Z B )B + A(Z B B - BN B ) gives 

{2iy± ZAtNB {AB) - & Za ,n a A .B + A. A Na , Zb I .B + A. A ZbiNb B, 

which eventually proves the theorem, since the rank of a product is always 
smaller than the rank of each of its terms. □ 

A similar result holds for displacement V. A direct consequence of 
equation (21) is the following corollary, that looks like a differentiation 
rule. 

Corollary 3.8. When A and B have dual displacement patterns, we 
obtain the following simple result: 

Az,z(AB) = A z ,nA . B + A . A N , Z B. 

In particular, if AB = I, this displaced matrix is null, because of (15). 



VTi 



id 


X 


X 
X 
X 


XXX 
X | 
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Corollary 3.9. Let A be a full-rank m x n matrix, with m > n. 
Then its pseudo-inverse B = (A*A)~ 1 A* has a reduced displacement rank, 
as show the two bounds below: 

(22) 6% >Z {B}<6* N {A} + 26% >Z {A*}, 

(23) 4,z*{B} < 3S* N {A} + 5%. tZ {I m }. 

Proof. Apply corollary 3.8 to A* A, next theorem 3.1, and lastly theo- 
rem 3.7. □ 

Example 3.10. If A is Toplitz, equation (22) claims that Sg S {B} < 6. 
In practice, it seems that no Toplitz matrix could yield a displacement rank 
larger than 6§ S {B} = 4, which suggests that the bound is much too large. 

Definition 3.11. Given any matrix A, if a matrix A~ satisfies 

(i) AA~ A = A, (ii) A~AA~ = A~, 

(24) (Hi) (AA-)* = AA~, (iv) (A- A)* = A~ A, 

then it will be called the Moore-Penrose (MP) pseudo-inverse of A. A so- 
called generalized inverse need only to satisfy conditions (i) and (ii). 

It is well known that A~ is unique, and that A~ and A* have the 
same range and the same null space [12]. On the other hand, a generalized 
inverse is not unique. When a matrix A is rank deficient, it is in general not 
possible to construct a MP pseudo-inverse having the same displacement 
rank, as will be demonstrated in section 5. 

4. The space of P-symmetric matrices. In this section, more spe- 
cific properties shared by matrices in a wide class will be investigated. The 
property of P-symmetry will be necessary in section 5 to transform a matrix 
into its transposed just by a congruent transformation. 

Definition 4.1. Let P be a fixed orthogonal n by n matrix. The set 
of P-symmetric matrices is defined as follows: 

(25) S P = {M e M nxn /PMP* = M*}, 

where (*) denotes transposition and LR the set of real numbers. 

It will be assumed in this section that the matrix to invert (or the 
system to solve) belongs to Sp, for some given known orthogonal matrix 
P. For instance, if a matrix A is square and Toplitz, then it is centro- 
symmetric and satisfies 



J A J* = A*, 
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which shows that A e Sj, where J denotes the reverse identity: 

1 



(26) 



J = 



If A is Hankel, then A G Si because A is symmetric. The property of 
P-symmetry is interesting for it is preserved under many transformations. 
For instance, singular vectors of a P-symmetric matrix are P-symmetric 
in the sense that if {u, v, a} is a singular triplet, then so is {Pv, Pu, <r}. A 
sum or a product of P-symmetric matrices is P-symmetric. 

Example 4.2. Define the 'alternate Toplitz matrix' below 

(2-2-2 1 1 \ 

1 -2 -2 2 1 

1 1 2-2-2 

4-1 1-2 -2 

\ -8 4 1 1 2 ) 

and assume the displacement pattern 

/ \ 
1 

-1 , and N = -Z*. 
10 
\ -1 / 

Then we have PAP* = A* as requested in the definition above, with P = J. 
This matrix has displacement ranks 5^ N {A} = 2 and 8%, n{A} = 2, and is 
singular. The displacement rank of its MP pseudo inverse will be calculated 
in example 5.4. 

Property 4.3. 
equivalent. 



The properties of P-symmetry and P* -symmetry are 



Proof. Let A be P-symmetric. Then transposing (25) gives M = 
PM*P*. Next pre- and post-multiplication by P* and P, respectively, 
yields P*MP = M*. U 

Theorem 4.4. If A is P-symmetric, then so is A^ 1 whenever A is 
invertible. If A is singular, then its Moore-Penrose inverse, A", is also 
P-symmetric. 

Proof. Inversion of both sides of the relation PAP* = A* yields imme- 
diately P^4 _1 P* = A^ 1 * . Now to insure that when A is singular, A~ is P- 
symmctric, it suffices to prove that the matrix B = PA~*P* indeed satisfies 
the four conditions of definition (24). First, ABA = APA~*P*A yields 
ABA = PA*A-*A*P* = PA*P = A, which shows (i) of (24). Second, 
BAB = PA-*P*APA-*P* yields similarly BAB = PA-*A*A~*P* = 
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PA~*P*, which equals B by definition. Next to prove (iii), consider AB = 
APA~*P*, which gives after premultiplication by PP*: AB = PA*A~*P*. 
But since (A~ A)* = A~ A, we have AB = PA~AP*. Then insertion of 
P*P yields finally AB = PA~P*A*, which is nothing else then B*A*. The 
proof of (iv) can be derived in a similar manner. □ 

It may be seen that in the last proof, A does not need to be a nor- 
mal matrix, which was requested in a similar statement in [15]. On the 
other hand, it is true that if A is P-symmetric, AA* is in general not 
P-symmetric. 

5. Displacement of MP pseudo-inverses. In section 3, it has been 
shown among other things that the pseudo-inverse of a full-rank matrix is 
structured. It will be now analyzed how the rank deficience weakens the 
structure of the MP pseudo-inverse. 

Theorem 5.1. Let A be a P-symmetric square matrix, and let Z and 
N be two displacement matrices linked by the relation 

(27) PZP = N. 

Then the displacement ranks of A and A~ are related by 

(28) Sl z {A-} < 2§l N {A}. 



In this theorem, the condition (27) is satisfied in particular for both 
close to Toplitz and close to Hankel matrices, with (P,Z,N) = (J,S,S*) 
and (P, Z, N) = (I, S, S), respectively. 

Proof. For conciseness, denote in short 5 the displacement rank S% N {A}, 
and assume A is n x n. In order to prove the theorem, it is sufficient to 
find two full-rank n x n — S matrices Pi and E 2 such that 

(29) E*V N , z {A-}E l =0. 

For this purpose, define the following full-rank matrices with n rows: 



(30) 



Gi = 


matrix whose columns 


span 


KerVA 


G 2 = 


matrix whose columns 


span 


Ker(VA)* 


Pi = 


matrix whose columns 


span 


KerAN n KerVA 


P 2 = 


matrix whose columns 


span 


Ker(ZA)* HPer(VA)* 


v x = 


matrix whose columns 


span 


ANGi 


v 2 = 


matrix whose columns 


span 


A*Z*G 2 - 



Then define the two matrices Pi as: 



Ei = \Vi, W i ],withW i = PK i . 
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Let us prove first that Ei are indeed of rank n — S, and then that (29) is 
satisfied. 

From (30), we have by construction AK\ = 0. Then inserting a factor 
P*P and premultiplying by P gives P AP* PK\ = 0, which shows that 
A*Wi = 0. Yet, V\ is in the range of A by definition, and thus V\ and W\ 
are necessarily orthogonal as members of the orthogonal subspaces Ker A* 
and ImA. In addition, P is bijective so that W\ has the same dimension 
as K\ . As a consequence, dimEi — dimV\ + dimK\ , which is nothing else 
but dimGi if we look at the definitions (30). Similarly, one can show that 
W 2 and V 2 are orthogonal because W 2 C Ker A. This yields after the same 
argumentation that dimEi = dimGi = n — 8. 

Now it remains to prove (29). To do this, it is shown that the four 
blocks of E 2 X7A~Ei are zero. The quantity \i = V 2 X?A~V\ is null since \i = 
G* 2 ZA(A~ -N A~ Z)ANGi can be written fi = G 2 ZANGi —G 2 ZANA~ ZANGi , 
which is the difference of two identical terms by construction of matri- 
ces d. In fact from (30), ZANGi = AG X and G* 2 ZAN = G* 2 A. Next 
W 2 WA~ is null because W 2 VA* is null (remember that A~ and A* have 
the same null space). In fact, W^VA* = K^P* A* - K 2 *P*NA*Z by 
definition of W 2 and V. Now using the relation (27) and P-symmctry 
of A yield W 2 VA*P = K^A - K^ZAN. These two terms are even- 
tually null by construction of K 2 . It can be proved in a similar man- 
ner that VA*Wi = 0. In fact, VA*Wi = A* PK\ - NA*ZPK 1 implies 
P*WA*Wi = AKi - P*NP*PA*P*PZPK 1 . Again these two terms can 
be seen to be zero utilizing (27), P-symmetry of A, and the definition (30) 
ofifi. □ 

This theorem is an extension of a result first proved in [7] . As pointed 
out in [8], when the displacement rank of A is larger than its rank, the 
theorem above gives too weak results as is next shown. 

Theorem 5.2. Let A be a square matrix, and denote by r{A} its 
rank. Then there exist two other bounds for the displacement rank of its 
MP pseudo-inverse: 

(31) S%, Z {A-} < 2r{A} if S^^ N {A} < 2r{A}, and 

(32) $N,zi A ~} < 2 H A } otherwise. 

Proof. The proof of (32) is easy. In fact, it holds true for any matrix 
M since 

rank{M - ZMN} < rank{M} + rank{ZMN} < 2rank{M} 

is always true. So let us prove (31). Since A has rank r{A}, it may be 
written as 

A = UZV*, 
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where £ is invertible and of size r{A}. Define the matrices A = [U ZU], 
B = [V N*V], and A = Diag(E, -£). Then it may be seen that 

VA = AAB*. 

Since A is of full rank, either A or B must be rank deficient, otherwise 
VA would be of rank 2rank{A} which is contrary to the hypothesis. Thus 
assume without restricting the generality of the proof that rank{A} < 
2r{A}. Then rank{\7A~} < 2r{A} because: 

VA-* = AA~ 1 B*. 

This completes the proof. □ 

Corollary 5.3. Let T and H be close to Toplitz and close to Hankel 
square matrices, respectively. Then 

(33) 5l. s {T-}<2Sl s ,{T}, Sl s {H-}<25ls{H}, 

(34) 6$ s {T-}<25§ iS {T} + 1, 8$. iS {H-} <25$ S .{H} + 1. 



Proof. To prove (33), simply use theorem 5.1 and relation (14). In 
order to prove equations (34), utilize theorem 2.5 and relation (15). □ 

Note that the bounds are tight enough to be reached, as now shown in 
examples. 

Example 5.4. Take again the matrix defined in example 4.2. This 
matrix is of rank 4 and displacement rank 2. In addition, the displacement 
pattern satisfies PZP = N as required in the theorem 5.1. With the 
notations of example 4.2, the MP pseudo inverse of A has displacement 
ranks 8$ Z »{A~} = 4 and 5% Z {A~} = 4. This is consistent with theorem 
5.1. 

Example 5.5. Define the 5x5 Toplitz matrix of rank 3 : 



A = 



( 2 4 3 1 2 \ 

1 2 4 3 1 

3 12 4 3 

4 3 12 4 

\ 2 4 3 1 2 / 



and assume as displacement pattern Z — S$ and N — S£. Then A has a 
displacement rank 5 ZN = 2, and its MP pseudo-inverse has a displacement 
rank 8% z equal to 4. This result was expected, according to corollary 5.3. 



Example 5.6. If H is Hankel, then the displacement rank of H 
respect to the displacement operator As»,s is bounded by 5. 



with 
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Other particular examples can be found in [7] and [8]. Let us now 
switch to the case of rectangular and rank-deficient structured matrices. 
In order to extend corollary 3.9, we need a variant of the inversion lemma: 



Lemma 5.7. Let M be the block matrix. 

M = 



P A 2 
A x 

where P is square invertible, and where A\ and A 2 have the same rank. 
Then the MP-pseudo-inverse of M is: 



M~ = 



Y -P~ 1 A 2 X 

-XA X P- X X 



where X = -{A 1 p- 1 A 2 )-, and Y = P' 1 + P- 1 A 2 XA 1 P~ 1 . 

Proof. Let A l = U l D i V* denote the SVD of A^. Then define the matrix 

U 2 \ „ ( V x 



M — [ 2 ) M , 

Ut ) \ V 2 

and apply the usual inversion lemma to the invertible square portion of M, 
denoted B. In other words we have: 

inr ( B A l ( B- 1 

M= ( o o J andM = { 

The last lines of the proof are then just obvious manipulations. □ 

Corollary 5.8. Let A be an m x n rectangular matrix with m > n. 
Then the displacement rank of its MP pseudo inverse verifies 

5% >Z {A-} < 36* Z {A*} + 25% N {A) + 26% >N .{I m }. 



Proof. Write A as (A* A) A*, apply theorem 5.1 to the square matrix 
(A* A), and then apply the product rule given in corollary 3.9. □ 

6. Concluding remarks. In this paper various aspects of the dis- 
placement rank concept were addressed in a rather general framework. In 
particular, displacement properties of rank-deficient matrices were inves- 
tigated. However the bounds given in corollaries 3.9 and 5.8 are obvi- 
ously too large. It is suspected that corollary 5.8 could be improved to 
5{B} < 25{A} + 5{I} in most cases. On the other hand, particular exam- 
ples have been found showing that the bounds given in other theorems are 
indeed reached (in particular theorems 5.1 and 5.2). 

Another major limitation of this work lies in the fact that our proofs 
arc in general not constructive, in the sense that they do not define suitable 
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algorithms having the expected complexity. This is now the next question 
to answer. First ideas in this direction can be found in [4] and [14] and 
could be used for this purpose. 

The author thanks Georg Heinig for his proofreading of the paper. 
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